The era of artificial intelligence in music has become a reality. Using OpenAI’s text-to-video model Sora, a music video for the song “The Hardest Part” was created with AI. AI has now ventured into pop music, and this seems to be just the beginning. Here are the details…
The world’s first AI music video becomes reality with Sora
Although OpenAI has not yet made Sora publicly available, this technology’s capacity to create realistic and high-resolution videos is causing concern among professionals, from traditional directors to drone operators. And they are justified…
This AI-generated music video is part of Ernest Weatherly Greene Jr.’s Washed Out project. The four-minute clip was created from 55 text inputs into Sora, forming fly-through scenes, which were then combined using Adobe Premiere Pro. According to the creators, the video received “minimal retouching,” but we’ll let you decide.
The AI-created young characters and environments appear on screen only briefly. The unusual angles, strange heads, jittery movements, and so-called special effects may be processing errors from Sora or intentional, but the result is quite pleasing.
It seems that director Paul Trillo has had the idea for such a music video for a decade. This video was conceived as an improved version of the 3D animated video for The Shins’ “The Great Divide.” In “The Hardest Part,” the virtual camera moves into the scenes, creating a dynamic visual effect for Washed Out’s song.
OpenAI introduced Sora in early 2024, surprising everyone with its ability to create breathtaking video clips from simple text descriptions. We had seen similar things before, but those videos were shorter (a few seconds) and had more graphical glitches. Later, there were short films made solely with Sora, some of which had additions in post-production.
Sora is a groundbreaking tool, and a one-minute short film released in late March demonstrates its potential once again. AI seems poised to shape the future of music videos. But what do you think? Could this technology replace traditional music videos? Feel free to share your thoughts in the comments section below.
{{user}} {{datetime}}
{{text}}